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CHARACTERIZING FOLLOWER AND EXTENDER SET 

SEQUENCES 

THOMAS FRENCH 


Abstract. Given a one-dimensional shift X, let \Fx(t}\ be the number of 
follower sets of words of length £ in X. We call the sequence {|Fx(^)|}£gN 
the follower set sequence of the shift X. Extender sets are a generalization 
of follower sets (see m), and we define the extender set sequence similarly. 
In this paper, we explore which sequences may be realized as follower set 
sequences and extender set sequences of one-dimensional sofic shifts. We show 
that any follower set sequence or extender set sequence of a sofic shift must be 
eventually periodic. We also show that, subject to a few constraints, a wide 
class of eventually periodic sequences are possible. In fact, any natural number 
difference in the lim sup and lim inf of these sequences may be achieved, so long 
as the lim inf of the sequence is sufficiently large. 


1. Introduction 

The complexity function of a shift X, counts the number of words of a 

given length £ in the language of the shift X. This function is natural to study; in 
particular, it may be used to calculate topological entropy of symbolic shifts. The 
Morse-Hedlund Theorem implies that if there exists £ G N with $x(£) < £, then 
every sequence in X must be periodic. (See [5]) 

For any Z shift X and finite word w appearing in some point of X, the follower 
set of w, written Fx{w), is defined as the set of all one-sided infinite sequences s 
such that the infinite word ws occurs in some point of X. The extender set of w, 
written Ex{w), is the set of all pairs of infinite sequences (s,u), s left-infinite and 
u right-infinite, such that swu is a point of A. It is well-known that for a Z shift 
X, finiteness of {Fx{w) \ w in the language of X} is equivalent to X being sofic, 
that is, the image of a shift of finite type under a continuous shift-commuting map. 
(see [4]) (In fact it is true that finiteness of {Ex{w) \ w in the language of X} is 
equivalent to X being sofic as well, see El)- 

We define the set Fx{£) to be {Fx{w) \ w has length £} for any positive in¬ 
teger £. Thus \Fx{£)\ is the total number of follower sets which correspond to 
some word w of length i in X. \Ex{£)\ is defined similarly for extender sets. 
Since the alphabet is finite, there are only finitely many words of a given length 
£, and so for any shift (sofic or not), \Fx{£)\ and \Ex{£)\ are finite for every £. 
If X is sofic, {Fx{w) \ w in the language of X} is finite, and thus the follower 
set sequence {|Fx(£)|}^gn must be bounded, and similarly for the extender set 
sequence {|ifx(£)|}ieN- Ormes and Pavlov have proved a result in the style of 
Morse-Hedlund, that if \Ex{£)\ < £ for any £ G N, then X is necessarily sofic. 
(See [B]) This may lead one to believe that there is a connection between those 
sequences which may appear as complexity sequences of shifts and those which 
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may appear as extender set sequences of shifts. The results in this paper suggest 
otherwise; in particular, extender set sequences need not be monotonic! 

First, any follower set sequence or extender set sequence of a one-dimensional 
sofic shift must be eventually periodic: 

Theorem 1.1. Let X be a one-dimensional sofic shift, p be one greater than the 
total number of extender sets in X, and po be one greater than the total number 
of follower sets in X. Then the extender set sequence eventually 

periodic, where the periodicity must begin before the p{l plf^ term, and the least 
eventual period is at mostpl. The follower set sequence {|Fx(f’)|}^GN eventually 
periodic, where the periodicity must begin before t/ie po(l+PoO*^ term, and the least 
eventual period is at mostpol. 

For simple examples, the follower set sequence and extender set sequence of a 
sofic shift are eventually constant, but in fact, sequences may be realized which are 
merely eventually periodic. This is in contrast to complexity sequences of shifts, 
which must be nondecreasing. Martin Delacourt discovered the first such example 
in 2013. (see page 8 of i) In fact, a wide class of eventually periodic sequences 
may be realized: 

Theorem 1.2. Let n € N, and A = {Ai, A 2 , A 3 , ...,Ak} be a nontrivial partition 
of {0, 1,..., n — 1}. Let 0 = ri < r 2 < ... < Vk be natural numbers. Then there exists 
m S N and an irreducible graph Q such that the number of follower sets in Xg of 
words of length t where £ > n 2 and i (mod n) G Aj will be exactly m -\- rj for 
all 1 < j < A:. Furthermore, m may be chosen such that m < (6n -|- 3)rfc. 

We also prove a similar result for extender sets: 

Theorem 1.3. Let n G N, and A = {Ai, A 2 , A 3 , ...,Ak} be a nontrivial partition 
of {0, 1, ...,n— 1}. Let 0 = ri < r 2 < ... < be natural numbers. Then there exists 
m G N and an irreducible graph Q such that the number of extender sets in Xg of 
words of length £ where £ > lArtn — 1 and £ (mod n) G Aj will be exactly m rj 
for all 1 < j < k. Furthermore, m may be chosen such that m < ‘SQn^rf,. 

The proofs of Theorems |1.2| and |1.3| are broken into two parts. First, we define 
a process, given n G N and S C {0,1, ..., n — 1}, of constructing a graph Qn^s which 
gives words of length £ (mod n) G S one greater follower and extender set than 
words of length £ (mod n) ^ S whenever £ is sufficiently large. We then describe a 
method of combining these graphs which results in a new shift, where for each £, the 
number of follower or extender sets of words of length £ is the sum of the number 
of follower or extender sets of words of length £ in each of the original shifts, plus 
a constant which does not depend on t. Combining these two propositions proves 
the result. 

Finally, while non-sofic shifts always have follower set sequences and extender 
set sequences which go to infinity, we show that they need not do so in a monotone 
increasing fashion: 

Theorem 1.4. There exists an irreducible non-sofic shift X such that {|Fa(^)|}£gn 
and {\Exi£)\}e(^ N are not monotone increasing. 

2. Definitions and preliminaries 

Let A denote a finite set, which we will refer to as our alphabet. 
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Definition 2.1. A word over A is a member of A” for some n € N. 

Definition 2.2. For any words v G A" and w G A™, we define the concatenation 
vw to be the pattern in A"+'" whose first n letters are the letters forming v and 
whose next m letters are the letters forming w. 

Definition 2.3. The language of a Z shift X, denoted by L{X), is the set of all 
words which appear in points of X. For any finite £ G N, Li{X) := L{X) n A^, the 
set of words in the language of X with length 1. 

Definition 2.4. For any one-dimensional shift X over the alphabet A, and any 
word w in the language of X, we define the follower set of w in Fxiw), to 
be the set of all one-sided infinite sequences s G A’^ such that the infinite word ws 
occurs in some point of X. 

Definition 2.5. For any one-dimensional shift X over the alphabet A, and any 
word w in the language of AT, we define the extender set of w in AT, Ex{w), to 
be the set of all pairs (s, u) where s is a left-infinite sequence of symbols in A, u is 
a right-infinite sequence of symbols in A, and swu is a point of X. 

Remark 2.6. For any word w G L{X), define a projection function ■ Ex{w) -G 
Fx{w) by /(s, u) = u. Such a function sends the extender set of w onto the follower 
set of w. Any two words w, v with the same extender set would have the property 
then that fw{Ex{w)) = fv{Ex{v)), that is, that w and v have the same follower 
set. 

Definition 2.7. For any positive integer £, define the set ExW = {Fx{w) I w G 
L^(X)}. Thus the cardinality \Ex{£)\ is the number of distinct follower sets of 
words of length f in AT. Similarly, define Ex{i) = {Exiw) \ w G L^(Ar)}, so that 
\Ex{tj\ is the number of distinct extender sets of words of length ^ in AT. 

Definition 2.8. Given a shift X, the follower set sequence of X is the sequence 
{|Fx(f?)|}^eN- The extender set sequence of X is the sequence {|iilx(^)|}feN- 

Example 2.9. Let X be a fnll shift on the alphabet A. Then any word w G L{X) 
may be followed legally by any sequence in A^, and thus the follower set of any word 
is the same. Hence there is only one follower set in a full shift. Similarly, there is only 
one extender set in a full shift. Then {|Tx(^)|}^eN = {|^'a(^)|}^gn = {lAA)---}- 

Example 2.10. The even shift is the one-dimensional sofic shift with alphabet 
{0,1} defined by forbidding odd runs of zeros between ones, ft is a simple exercise 
to show that the even shift has three follower sets, E{0),F{1), and F'(IO). The 
follower set sequence of the even shift is {|Fx(^)|}feN = {2, 3, 3,3,...}. ft is easy to 
verify that for any word w in the language of the even shift, the follower set of w 
is identical to the follower set of one of these three words. 

Definition 2.11. A one-dimensional shift X is sofic if it is the image of a shift of 
finite type under a continuous shift-commuting map. 

Equivalently, a shift X is sofic iff there exists a finite directed graph Q with 
labeled edges such that the points of X are exactly the sets of labels of bi-infinite 
walks on Q. Then is a presentation of X and we say X = Xg (or that X 
is the edge shift presented by fj). Another well-known equivalence is that sofic 
shifts are those with only finitely many follower sets, that is, a shift X is sofic 
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iff {Fx{w) I w in the language of X} is finite. The same equivalence exists for 
extender sets: X is sofic iff {Ex{w) \ w in the language of X} is finite, (see [5]) 
This necessarily implies that for a sofic shift X, the follower set sequence and 
extender set sequence of X are bounded. In fact, the converse is also true: if the 
follower set or extender set sequence of a shift X is bounded, then X is necessarily 
sofic. (See [6]) 

Definition 2.12. A directed labeled graph Q is irreducible if for every ordered 
pair (/, J) of vertices in Q, there exists a path in Q from I to J. 

Results about shifts presented by graphs which are not irreducible may often be 
found by considering the reducible graph’s irreducible components; for this reason, 
results in Sections and of this paper will focus on the irreducible case. 

Definition 2.13. A directed labeled graph Q is primitive if 3 A^ € N such that 
for every n > N, for every ordered pair (/, J) of vertices in Q, there exists a path 
in Q from / to J of length n. The least such N is the primitivity distance for Q. 

Definition 2.14. A directed labeled graph Q is right-resolving if for each vertex 
/ of Q, all edges starting at / carry different labels. Similarly, Q is left-resolving 
if for each vertex / of G, all edges ending at I carry different labels. 

Definition 2.15. A directed labeled graph G is follower-separated if distinct 
vertices in G correspond to distinct follower sets-for all vertices I, J in G, there 
exists a one-sided infinite sequence s of labels which may follow one vertex but not 
the other. 

Definition 2.16. A directed labeled graph G is extender-separated if distinct 
pairs of vertices correspond to distinct extender sets-for any two distinct pairs of 
initial and terminal vertices {/ —>■ /'} and {J — J'} such that there exist paths 
in G from I to I' and from J to J', there exists some word w which is the label 
of a path in G beginning and ending with one pair of vertices, and pair (s,u), s a 
left-infinite sequence, u a right-infinite sequence, such that swu is a point of Xg^ 
but for every word v which is the label of some path beginning and ending with 
the other pair of vertices, svu is not a point of Xg. 

Definition 2.17. Given a directed labeled graph G, a word w is right-synchronizing 
if all paths in G labeled w terminate at the same vertex. The word w is left- 
synchronizing if all paths in G labeled w begin at the same vertex. The word w is 
bi-synchronizing if w is both left- and right-synchronizing. A bi-synchronizing 
letter is a bi-synchronizing word of length 1. 

In fact, every one-dimensional sofic shift has a presentation G which is right¬ 
resolving, follower-separated, and contains a right-synchronizing word. (See [1]) 

3. Eventual Periodicity of Follower and Extender Set Sequences 

First, we show that only eventually periodic sequences may appear as follower 
set sequences or extender set sequences of one-dimensional sofic shifts. To establish 
this result, we first need a lemma which is reminiscent of the pumping lemma. 
(See [SI) 

Lemma 3.1. Let X be a sofic shift, define p to be one greater than the total 
number of extender sets in X, and define po to be one greater than the total number 
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of follower sets in X. Then all words w in L{X) of length £ > p may be written as 
w = xyz, where \y\ > 1 and the word xy''z has the same extender set as the word 
w for all i € N. Furthermore, all words w in L{X) of length £ > po may be written 
as w = xyz, where \y\ > 1 and the word xy^'z has the same follower set as the word 
w for all i S N. 


Proof. Since X is sofic, X has only finitely many extender sets. Let p be one greater 
than the number of extender sets in X. Since X is represented by a finite labeled 
graph Q, and there are only possible pairs of vertices in Q, and each extender 

set must correspond to a non-empty set of pairs, we have that p < \ Let 

w be a word in L{X) of length £ > p. Consider the prefixes of w. Since w is of 
length at least p, there exist two prefixes of w (one necessarily a strict subword of 
the other) with the same extender set, say x and xy, where \y\ > 1. Then for any 
pair (s,m) of infinite sequences, sxu is a point of X if and only if sxyu is a point 
of X also. Call the remaining portion of ic by 2 ; so that w = xyz. (We may have 

kl = o). 

Now, let (s, u) be in the extender set of w, that is, that swu is a point of X. But 
swu = sxyzu, so {s,yzu) is in the extender set of x. By above, then, (s,yzu) is in 
the extender set of xy also, that is, that sxyyzu is a point of X. Hence, (s,u) is in 
the extender set of xyyz. So Ex{xyz) C Ex{xyyz). On the other hand, if {s,u) is 
in the extender set of xyyz, then sxyyzu is a point of X, and so {s,yzu) is in the 
extender set of xy, and therefore the extender set of x. Thus sxyzu is a point of X, 
and so (s,u) is in the extender set of xyz = w. Therefore Ex{xyz) = Ex{xyyz). 
Applying this argument repeatedly gives that Ex {xyz) = Ex{xy^z) for any i G N. 

Letting po be one greater than the total number of follower sets in X, and 
identical argument gives the corresponding result for follower sets. □ 

We use this lemma to establish Theorem o that all follower set and extender 
set sequences of one-dimensional sofic shifts must be eventually periodic: 


Proof of Theorem 0 Let A be a one-dimensional sofic shift. We prove that the 
sequences {Fx{£)} and {Ex{£)} (that is, the sequences which record not only the 
number of follower sets of each length, but also the identities of those sets) are 
eventually periodic, which will trivially imply eventual periodicity of {|T'x(^)|} and 
{\Ex{£)\}. 

Let w be a word of length p in L{X), where p is defined as in Lemma 3.1 Then 
w = xy^z where \yw\ > 1 and xyl„z has the same extender set as 
N. Let k = lcm{\yw\ \ w G Lp{X)}. Since the longest such a word 


3.1 


by Lemma 
w for all i G 

yw could be is p, we have k < p\. Clearly for any word w G Lp{X), there is an 
i G N such that xyl,z G Lp^k{X). Therefore, every extender set in Ex{p) is also 
an extender set in Ex{p + k), so Ex{p) C Ex{p + k). 

Now, let w be a word of length £ > p in L{X). Then w has some word w' = 
wi...Wp G Lp{X) as a prefix. Applying Lemma 3.1 to w' as above, we get a word 
w" of length p + k with the same extender set as w'. If (s, u) is in the extender set 
o£w = w'wp.^-l...we, then sw'Wp+i...wiu is a point of X, and so {s,Wp+i...wiu) is in 
the extender set of w'. Since w' and w” have the same extender set, sw"Wp+i...wiu 
is a point of X, and {s,u) is in the extender set of w"wp+i...wi. Similarly, if {s,u) 
is in the extender set of w"wp+i...wi,, then (s, u) is in the extender set of w as well. 
Therefore w"wp.^i...wi is a word in X of length £ + k with the same extender set 
as w. Hence, every extender set in Ex{£) is an extender set in Ex{£ + k). So 
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Exi^) Q Ex{i + k) for any i > p. 

But sofic shifts only have finitely many extender sets, so eventually, the sequence 
{\Exi£ + niust stop growing. Thus, we have Ex{E) = Ex{i + k) for all 

sufficiently large i, and the sequence {Exi^)} is eventually periodic with period fc, 
where k < p\. Certainly, this implies that the extender set sequence is eventually 
periodic with period k as well. 

Suppose £ >p and Ex{£) = Ex{£ + k). Then we claim that Ex{£ + k) = Ex{£ + 
2 k): By above, we have Ex{£ + k) C Ex{£ + 2fc). Suppose w is a word of length 
£ + 2fc, say w = wi?C 2 ---'w^+feWf+fc+i---w^+ 2 /c- Then, because Ex{£) = Ex{£ + fc), 
there exists a word z of length £ such that z and wiW 2 ---wt+k have the same extender 
set. Let (s,u) be in the extender set of w. Then swiW 2 ---Wi+kWi+k+i---Wi+ 2 kU is 
a point of X, so {s,W£+k+i---Wi+ 2 ku) is in the extender set of WiW 2 ---'Wi+k, and 
thus in the extender set of z. So szw£+k+iWi+k+ 2 ---Wi+ 2 k'U' is a point of X. Hence 
(s,m) is in the extender set of zwi+k+iwe+k+ 2 ---we+ 2 k, a word of length £ + k. 
Similarly, if (s, u) is in the extender set of zwi+k+iwe+k+ 2 ---uii+ 2 k, then (s,u) is in 
the extender set of w, giving Ex{w) = Ex{zwi+k+iwe+k+ 2 ---Wi+ 2 k)- Therefore we 
have Ex{£ + 2fc) C Ex{£ + k) and we may conclude that Ex{£ + k) = Ex{£ + 2fc). 

Now, {\Ex{£)\} < p for any given £ G N. Moreover, we have proven that the 
sequence {Ex{£ + jk)}j^fi is nondecreasing and nested by inclusion, and once two 
terms of the sequence are equal, it will stabilize for all larger j. The sequence 
{Ex{£ + j^)}jGN rnust grow fewer than p times, so the periodicity of the sequence 
{Ex{£)} (and thus of {\Exi£)\}) must begin before thep+pA:*^ term, andp+pfc < 

p + p(p!) =p(l +p!). 

Again, a similar argument using the follower set portion of Lemma 3.1 establishes 
the corresponding result for follower sets. □ 


4. Existence of Eventually Periodic Nonconstant Follower and 

Extender Set Sequences 

Now we demonstrate the existence of sofic shifts with follower set sequences 
which are not eventually constant. Given n G N and S C {0,1, 1}, construct 

an irreducible graph Qn,s in the following way: 

First, place edges labeled p, q and b as below, followed by a loop of n-many edges 
labeled a. We will refer to the initial vertex of the edge p as “Start.” 


Start 



a 


Choose a fixed i* G S. Then for every i G S, i i*, place two consecutive edges 
Ci and di, such that the intial vertex of is the {i — 2 (mod n))‘^ vertex of the 
loop of edges labeled a (where we make the convention that the terminal vertex of 
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the edge b is the 0*^ vertex of the loop, the next vertex the 1®* vertex of the loop, 
and so on) and the terminal vertex of di is “Start.” For i*, we still add the edge , 
but follow it instead by another edge labeled b and another loop of n-many edges 
labeled a: 



Again, V i € S', at the (z — 2 (mod n))*^ vertex of the new loop, add an edge Cj, 
and if z ^ z*, follow with an edge returning to Start. After Ci», add a third loop 
of n-many edges labeled a: 



Finally, for each z G S, (including z*), add an edge Ci from the (z — 2 (mod n))‘^ 
vertex of the third loop returning to Start. The resulting graph is Gn,s- Due to 
choice of i*, there are |S|-many possible graphs Qn,s] the results of this paper will 
hold for any of them. 


Start 



Back to 
Start 


Figure 1. 05 ,{o, 3 } with z* = 3 (where we use the convention that 
edges terminating at “Back to Start” return to the initial vertex 
of the edge p.) 



THOMAS FRENCH 


We first make some basic observations about the graphs Gn,s- It is easy to 
check that for any n, S, the graph Gn,s "'^iU be irreducible, right-resolving and left¬ 
resolving, follower-separated and extender-separated. We furthermore observe that 
the graph is primitive: 

Lemma 4.1. For any n G N, S' C {0,1,..., n — 1}, the graph Gn,s is primitive, and 
the primitivity distance of Gn,s is at most 3n -|- 3. 

Proof. Any irreducible graph with a self-loop is primitive, so due to the self-loop 
labeled q, Gn,s is primitive. So long as a path passes the vertex at which q is 
anchored, that path may be inflated to any greater length by following the self-loop 
q repeatedly. Given any two vertices I and J in Gn,S: we may clearly get from I to 
J, while being certain to also pass the vertex anchoring q, by traveling through each 
loop of edges labeled a at most once (and following at most n — 1 of the edges in each 
loop), and using no more than six letters total for the connecting paths between the 
loops. Thus, the longest path required to travel from one vertex to another in Gn,s, 
requiring that such a path pass through the vertex which anchors q, is of length at 
most 3(n — 1) -I- 6 = 3n -I- 3. For instance, if S' = {!}, the shortest possible path 
from the initial vertex of p to itself is labeled by the word p6a"“^Ci6a"“^Cia”“^Ci, 
which clearly travels through the vertex anchoring q. This is a sort of “worst-case” 
scenario, where, because |S| = 1, the shortest path requires traveling through all 
three loops of the graph, and with i* = 1, the exit of each loop is as far away from 
the entry point as possible. □ 

Any graph Gn,s created by the above construction will yield a shift with a follower 
set sequence and extender set sequence of period n with a difference in lim sup and 
liminf of 1: 

Theorem 4.2. Let n G N and S C {0, l,...,n — 1}. Then the shift Xg^ ^ has 
3n -|- 3151 -|- 4 follower sets for words of length i where £ > n 2 and I (mod n) G 
S, and only 3n -|- 3|5| -I- 3 follower sets for words of length £' where £' > n + 2 
and £' (mod n) ^ S. Furthermore, the shift Xg^ ^ has (3n -|- 2|5| -|- 1)^ -I- |5| -I- 3 
extender sets for words of length £ where £ > in + 3 and £ (mod n) G S, and only 
{in + 2|5| -I- 1)^ -I- |5| -I- 2 extender sets for words of length £' where £' > in + i and 
£' (mod n) ^ S. 

Proof. Let £ > n + 2. Let G = Gn,s as defined above. We will find the number of 
follower sets and extender sets of words of length £ in Xg (though for one part of 
the extender set case, we will need to require £>in-\-i). Each follower set Fx{w) 
is uniquely determined by the set of terminal vertices of paths labeled w in G, and 
each extender set Ex{w) is determined by the set of pairs {/ —:► T} of initial and 
terminal vertices of paths labeled w in G- 

Since in G the words p, q, Ci*b, di, Ci, and Ci*a are right-synchronizing, the 
longest path required to get from a right-synchronizing word to any vertex of G 
is n + 2. Because £ > n + 2, and the graph G is irreducible and right-resolving, 
every singleton represents the follower set of some word w of length £. There are 
in -I- 2|5| -I- 1 such follower sets, all distinct as G is follower-separated. 

It is easy to see that the right-synchronizing words listed above are in fact bi¬ 
synchronizing. Since the graph G is both left- and right-resolving, if a legal word 
w contains any bi-synchronizing word, then only one pair {/ —>■ T} can be the 
initial and terminal vertices of paths labeled w. li £ > in + 3, by Lemma |4.1| every 
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single pair {/ —> T} corresponds to the extender set of some word w of length £. 
There are (3n + 2|S'| + 1)^ such extender sets, all distinct as Q is extender-separated. 

Note that for the graph Q, recording the labels of two edges beyond any loop of 
edges labeled a, whether before or after the loop, results in a bi-synchronizing word. 
Since any word which would be capable of having a follower set not corresponding 
to a singleton (or of having an extender set not corresponding to a single pair of 
initial and terminal vertices) must be one which avoids all bi-synchronizing words, 
and £ > n + 2 > 2, any word of length £ with such a follower or extender set must 
include a string of a’s, and no more than 1 letter on either side of such a string. So 
only words of the forms a^, ka^~^, and ka^~‘^k' (where k and k' are labels 

appearing in Q not equal to a) can terminate (or begin) at more than one vertex. 

The word has 1 follower set, corresponding to all 3n vertices involved in 
loops of edges labeled a. This follower set is distinct from those corresponding to 
singletons, for which we have previously accounted. Similarly, the extender set of 
the word is distinct from those for which we have previously accounted. 

The label a is only followed in Q by the labels a and Ci for all i G S. For each Cj, 
the word a^~^Ci has a unique follower set corresponding to three terminal vertices, 
one for each loop in which the may occur. Thus there are |S'|-many follower 
sets of this form, all distinct from previous follower sets. Similarly, there are |S'|- 
many extender sets of this form, all distinct from previous extender sets as well. 

The label a is only preceded in Q by the labels a, b, and q*. Since c^-a is bi¬ 
synchronizing, the follower set for the word corresponds to a singleton and 

has already been counted. The word ba^~^ has a follower set corresponding to two 
terminal vertices, one in each loop of edges labeled a which is preceded by b. Hence 
there is 1 additional distinct follower set of this form, and again this behavior is 
mirrored by the extender sets-there is 1 additional distinct extender set for the 
word ba^~^. 

Finally, based on our above observations, if a word of the form ka^~‘^k' is to 
have a follower set corresponding to a greater number of vertices than one, that 
word must be of the form ba^~^Ci. By construction, a path with this label only 
exists in Q ii £ (mod n) G S. If such a path exists, it contributes a single new 
follower set corresponding to two terminal vertices, each one edge past a loop of 
edges labeled a that is preceded by the label b. This follower set cannot repeat one 
that we already found: ii i ^ i*, then the follower set of ba^~^Ci is exactly the set 
of all legal sequences beginning with di or , clearly not equal to the follower set of 
any other word of length £. li i = i*, the follower set of ba^~^Ci contains sequences 
beginning with each of the letters a and b, but no other letter, again setting it 
apart from any other follower set previously discussed. Similarly, the word ba^~‘^Ci 
contributes a single new extender set for any length £ for which a path with this 
label exists. 

Therefore, in Xg, if £ >n + 2 and £ (mod n) G S, there are 3n-|-2|S'|-|-l-|-l-|- 
|S'| + 1-|-1 = 3n-|-3|S'|-|-4 follower sets of words of length £, while if £' > n + 2 
and £' (mod n) ^ S', there are only 3n -I- 3|S| -I- 3 follower sets of words of length £'. 
Moreover, if ^ > 3n-|-3 and I (mod n) € S, there are (3n-|-2|S|-|-l)^ + l-|-|S|-|-l-|-l = 
(3n -I- 2|S| -I- 1)^ -I- |S| -I- 3 extender sets of words of length £, while if £' > 3n -I- 3 and 
£' (mod n) ^ S, there are only (3n -|- 2|S| -I- 1)^ -I- |S| -I- 2 extender sets of words of 
length £!. 

□ 
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So, for the shift presented by the graph in Figure for £ > 7, the follower set 
sequence oscillates between \Fx{t)\ = 3(5) + 3(2) + 4 = 25 if £ = 0 or 3 (mod 5), 
and \Fx{t)\ = 24 if £ = 1, 2, or 4 (mod 5). Moreover, for £ > 18, the extender set 
sequence oscillates between \Ex{t}\ = (3(5) + 2(2) + 1)^ + (2) + 3 = 405 if £ = 0 or 
3 (mod 5), and \Ex{i)\ = 404 if £ = 1, 2, or 4 (mod 5). 

We have now demonstrated the existence of sofic shifts whose follower set se¬ 
quences and extender set sequences eventually oscillate between two different (but 
adjacent) values. We may furthermore combine these graphs, forming new graphs 
presenting shifts whose follower set sequences and extender set sequences oscillate 
by more than 1: 

Theorem 4.3. LetQi andQ 2 be two finite, irreducible, right-resolving, left-resolving, 
primitive, extender-separated labeled graphs with disjoint label sets, each containing 
a self-loop labeled by a bi-synchronizing letter qi and q 2 respectively. Let Ii be the 
anchoring vertex of qi in Qi and I 2 be the anchoring vertex 0/(72 w Q 2 - Let x,y 
be letters not in the label set of Qi or ^ 2 - Construct a new graph Q by taking the 
disjoint union of Qi and Q 2 cind adding an edge labeled x beginning at Ii and ter¬ 
minating at I 2 and an edge labeled y beginning at I 2 and terminating at Ii. Then 
Q is finite, irreducible, right-resolving, left-resolving, primitive, extender-separated, 
contains a self-loop labeled with a bi-synchronizing letter, and for any £ G N, 

\Fx,m = \Fx,M + \FxoM- 

Moreover, for any £ greater than twice the maximum of the primitivity distances of 
Qi and Q 2 , 

\Ex,{()\ = \Ex,,m + |f;a,,(£)| + 2|y(£/i)| • \v{g2)\. 



Proof. The reader may check that Q is finite, irreducible, right-resolving, left¬ 
resolving, primitive, extender-separated and contains a self-loop labeled with a 
bi-synchronizing letter. We first check that this construction does not cause any 
collapsing of follower or extender sets. That is, if two words w and v had distinct 
follower or extender sets in Xg.^ U , then they have distinct follower or extender 
sets in Xg. We present the argument for follower sets; the argument for extender 
sets is similar. 

If for two words w and v in Lg{Xg^) U LfiXgfij, we have F(w) ^ F(v), then 
there exists a sequence s in Xg^ or Xg^ which may follow one word but not the 
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other-without loss of generality, say that s may follow w but not v. Such a sequence 
may still follow w in ^ by following the same path labeled s which followed w 'mQi 
or Q2 to begin with. The sequence s still may not follow v, as no path existed in the 
parent graph Qi or Q2 labeled s following v, and any new paths introduced by our 
construction may not be labeled s, as s did not contain the letters x or y. Hence 
\Fxg,{t)\ + \Fxg^{()\ < \Fxg{,t)l and similarly, \Exg^{i)\ + \Exg^{t)\ < \Exg{Fj\. 

Now we establish that no extra follower sets are introduced by this construction. 
If two words w and v had the same follower set in Xg^ U Xg ^, then they certainly 
exist in the same parent graph, or Q 2 ; without loss of generality, say Qi. Let s 
be some sequence following re in tj. If the path in Q labeled s is contained within 
Qi, then s is part of the follower set of w in Xg^^ and thus, is part of the follower 
set of V in Xg^. So s may follow v in Q. On the other hand, if s is presented by 
a path traveling through both graphs, then s contains the letter x. Let z denote 
the maximal finite prefix of s without the letter x. A path labeled z follows w in 
Qi, and since z must terminate at /i in order to be followed by x, a path labeled 
zqi follows w in Qi as well. Then a path labeled zqi must also follow v in Qi, and 
since qi is left-synchronizing, there must exist a path labeled z following v in Qi 
terminating at /i. Snch a path may certainly, then, be followed by x, and indeed, 
the remaining portion of s, so s is in the follower set of v. Thus in Xg, the follower 
sets of w and v remain the same. 

Moreover, if a word v is not in either L^{Xg-^) or Li{Xg^), then v includes ei¬ 
ther the letter x or y. Since x and y are right-synchronizing, a path labeled v 
may terminate only at a single vertex. Due to the fact that Qi and Q 2 are each 
irreducible, right-resolving, and contain a right-synchronizing letter, there exists a 
word w in either Li{Qi) or Li(Q2) which terminates at the same unique vertex as 
paths labeled v. Since the right-synchronizing letter terminates at the same vertex 
as X or y, depending on the graph, we may construct w to be of the desired length £ 
in the following way: Let v = viV 2 ---vi and let Vi be the last occurrence of a; or 1 / in 
V. Then set Wi+iWij^ 2 ---wi = Vi+iVi+ 2 ---'Vi- Create Wi...Wi by replacing vi by qi or 
q2 (choosing the one which terminates at the same place as Vi) and then following 
any path backward in that same parent graph {Qi or Q 2 ) to fill in i — 1 labels before 
Wi- Then ru is a right-synchronizing word contained entirely in either Qi or Q 2 of 
length £ terminating at the same single vertex as v, and so w and v have the same 
follower set in Xg. Therefore the construction introduced no extra follower sets, 
nnd\Exgi£)\ = \Fxg^i£)\ + \Exg^i£)\. 

This construction also causes no splitting of extender sets: If w and v have the 
same extender set in Xg.^^ U Xg.^ , then they certainly exist in the same parent graph, 
Gi or 02', without loss of generality, say Gi- Let (s,u) be in the extender set of w. 
If s and u are both contained within Gi^ then {s,u) is certainly in the extender set 
of V as well. Otherwise, let z be the maximal suffix of s with no appearance of the 
letter y and z' be the maximal prefix of u with no appearance of x. (Note that in 
this case one of z and z' may be infinite, but not both.) Then zwz' is contained in 
Gi and since w and v have the same extender set in CJi, a path labeled zvz' exists 
in Gi as well. If z = s but z' is finite, then as above, z' may be followed by qi in 
Gi, which is left-synchronizing, so there must exist a path labeled z' following sv 
in Gi terminating at Ii. Such a path may certainly, then, be followed by x, and 
the remaining portion of u, and so (s,u) is in the extender set of v. Similarly, if 
z is finite but z' = u, then z may be preceded by qi, which is right-synchronizing. 
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SO there must exist a path labeled z preceding vu in Qi beginning at Ii. Such a 
path may then be preceded by y, and the preceding portion of s, and so (s, u) is in 
the extender set of v. If both z and z' are finite, then the path qizvz'qi exists in 
Qi, and so a path labeled zvz' exists in Qi beginning and ending at Ii which then 
may be extended to an infinite path labeled sum, so (s,m) is in the extender set of 
V. Thus E{w) = E{v). 

Finally, if a word v is not in either Li{Xq-^) or Li{Xg^), then v includes either 
the letter x or y. Since x and y are bi-synchronizing and Q is both left- and right¬ 
resolving, paths labeled v have exactly one pair {/ —>■ T} of initial and terminal 
vertices. If I and T are in the same parent graph Qi, we observe that if i is longer 
than twice the primitivity distance for Qi, we can construct a path w from I to Ii, 
and a path u from Ii to T, such that the path labeled wqiU has length 1. Because 
qi is bi-synchronizing, paths labeled wqiU have only one pair of initial and terminal 
vertices; the exact same initial and terminal vertices as v, so E{v) = E{wqiu). 
On the other hand, if I and T are in different parent graphs, then E(v) is cer¬ 
tainly not equal to the extender set of any word in U Li{Xg^), so the 

construction did introduce new extender sets of words of length i, but only at most 
2\V{Qi)\ ■ |I^(02)| many of them. Furthermore, if i is longer than the primitivity 
distance of Q, then all 2|y(^i)| • \V{Q 2 )\ such extender sets will be realized, and 
since Q is extender-separated, they will all be distinct. The primitivity distance for 
Q is at most one greater than the sum of the primitivity distances of Qi and Q 2 , so 
if i is greater than twice the maximum of the primitivity distances of and Q2, 
we have \Ex,ie)\ = \Ex,^ii)\ + \Ex,^ie)\ + 2\V{Q,)\■ \V{Q 2 )\. □ 


It is evident that the process outlined in Theorem 4.3 may be repeated an ar¬ 
bitrary number of times, and since the constant introduced (0 in the follower set 
case, 2\V{Qi)\ ■ \ V{Q 2 )\ in the extender set case) does not depend on £, we may use 
this process to increase the oscillations in the follower and extender set sequences 
of the resulting shift. We formalize this idea in Theorems |1.2| and |1.3[ which state 
that there exist sofic shifts with follower set sequences and extender set sequences 
of every eventual period and with any natural number as the difference in limsup 
and liminf of the sequence. 


Proof of Theorem \1.2[ Let Qn,s denote the graph constructed from n and S C 
{0,1,...,n — 1} as in Theorem 4.2 First construct Qn,A 2 UA 3 U...uAk- By Theo¬ 


rem |4.2[ this graph will give one more follower set to words of length £> n +2 and 
£ (mod n) € A 2 \JA^VJ...\jAk than to words of length £ > n+2 and £ (mod n) S Ai. 

Now, as Qn,A2UA3U...uAk is finite, irreducible, right-resolving, left-resolving, prim¬ 
itive, extender-separated, and contains a self-loop labeled with the bi-synchronizing 
letter q, we may use the process defined in Theorem |4.3| to join together r 2 many 
copies of Qn,A2uA3U...uAk only by giving each copy a disjoint set of labels. Call the 
resulting graph ^ 2 - For each £, the number of follower sets of words of length £ in 
Q 2 is the sum of the number of follower sets of words of length i in each of the r 2 
copies of Qn,A2UA3U...uAk- Therefore, the graph Q2 gives r2 more follower sets to 
words of length £> n + 2 with £ (mod n) G A 2 U A 3 U ... U Ak than to words of 
length £ > n + 2 with £ (mod n) G Ai. 

Using the same process, we may now join onto Q 2 another (ra — r 2 ) many copies 
of the graph Qn,A3UA4U...uAkJ call the resulting graph Q3. Now, words of length 
£ > n + 2 where £ (mod n) G A3U A4U ... U Ap^ will have (ra — r2) -f ^2 = ra more 
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follower sets than words of length i> n + 2 where i (mod n) G Ai, while words of 
length £ > n + 2 where £ (mod n) G A 2 will have only r 2 greater follower sets than 
words of length £> n + 2 where £ (mod n) G Ai. 

Continue on this way, adjoining next (r 4 — ra) copies of Qn,A 4 UA 5 U...uAk to make 
Q 4 , and so forth, terminating after constructing Qk- The graph will clearly be 
irreducible, and in Qk, for each 1 < j < k, words of length £ > n + 2 where £ 
(mod n) G Aj will have more follower sets than words of length £ > n + 2 where 
£ (mod n) G Ai. That is, if m is defined to be the number of follower sets of words 
of length £> n + 2 where £ (mod n) G Ai, then words of length £> n + 2 where £ 
(mod n) G Aj will have m + rj many follower sets in Xg^,. 

Using the formula established in Theorem 4.2 we see that for each Gn,s, words 
of lengths £> n + 2 whose residue classes are not in S have 3n + SIS'] + 3 many 
follower sets. Since Ai C for every graph used in the construction of Gk-, words 
of length £> n + 2 where £ (mod n) G Ai must have the following number of 
follower sets: 


Tn — T2{3n + 3|^2 C A ;4 U ... U Af^\ T 3) -t- (r3 — r2)(3R -t- 3|^3 U A 4 U ... U Ay^\ -t- 3) -t- . 

+ (+k ~ Tfc-l)(3R + 3|Afc| + 3) 

k k 

= r2(3n + 3^ + 3) + (r3 - r2)(3n + 3 ^|A,|+3) + ... 

k 

+ {fk ~ Tfc-i)(3 r + 3 'y ( \ Aj I + 3) 

j=k 

k k 

i =2 j=i 


k 

Furthermore, since for all z > 2, we have \ Aj\ < n, we get that 


k 

m < y^(u - ri_i){6n + 3) 

i^2 

k 

= (6n + 3)^(ri-ri_i) 
i^2 

= (6n + 3)rfc. 


□ 


This theorem shows that we may construct a sofic shift whose follower set se¬ 
quence follows any desired oscillation scheme-increasing or decreasing by speci¬ 
fied amounts at specified lengths and repeating with any desired eventual pe¬ 
riod. A similar result holds for extender set sequences, though the bounds for 
m = liminf{|Ux(f')|} and for the start of the periodicity of the sequence are differ¬ 
ent. 

Proof of Theorem [H We follow the same construction as in the proof of The¬ 
orem |1.2[ combining r^-many graphs using Theorem |4.3| to construct the graph 
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Gk- Then, in Gk, for each 1 < j < fc, sufficiently long words of length i where £ 
(mod n) € Aj will have rj more extender sets than sufficiently long words of length 
£ where £ (mod n) G Ai. That is, if m is defined to be the number of extender sets 
of words of sufficiently long words of length £ where £ (mod n) G Ai, then words 
of sufficient length £ where £ (mod n) G Aj will have m + Vj many extender sets in 
for all £ < j <k. 

To discover what length is sufficient for periodicity of the extender set sequence 
to begin, we observe that for every graph G used in the construction of Gk^ the 
primitivity distance of G is less than or equal to 3n + 3 as in Lemma 4.1 Note 
that, since n > 1, we have 3n + 3 < 7n — 1. (In fact, in any interesting case, n > 2, 
so 3n + 3 < 5n — 1, but n = 1 certainly may be chosen as a trivial case, where 
S = {0} necessarily). By Theorem 4.3 the eventual periodicity of the extender set 
sequence of the combination of two graphs begins before the 2z + 1®* term, where 
z is the maximum of the primitivity distances of the two graphs. So, when adding 
two graphs together in this construction, we get that the eventual periodicity be¬ 
gins before (3n -I- 3) -I- (3n -|- 3) -I- 1 < {In — 1) -|- {In — 1) -|- 1 = 14n — 1. (We 
observe that the primitivity distance of the resulting graph will also be less than 
14n — 1). Since n is the same for each graph involved in the construction, it does 
not matter which type of graph we are adding at each step, whether a copy of 
Gn^A2U. ..UAk 1 Gn^AsU.. .UAk ^ HP fO Gn^A^' 

Though we have performed the same construction as in Theorem |1.2[ we add 
our graphs in a more efficient order to minimize the effect of the constant 2|fo(^i)| • 

114(1/2)I- First consider the case where is a power of 2. Then we may choose to 
construct Gk in such a way that at each step, we add two graphs each made up 
of the same number of components. (2 graphs each consisting of 2 components to 
make 4, 2 graphs each consisting of 4 components to make 8, and so on). Then if 
ai is an upper bound for the start of primitivity at the step, an upper bound 
for the primitivity at the i 1®* step is 2(aj) -|- 1. Then letting ai = 7n — 1, the 
value of the sequence = 2(ai_i) -I- 1 at I = log 2 ('rfe) -|- 1 will give an upper bound 
for the start of primitivity for Gk, since we must add together two peices of equal 
components log 2 (rfc) times to construct Gk- 

We claim that for all i, ai = 2®“^(7n) — 1. This is trivially true for the base case, 
i = 1. By induction, suppose a^-i = 2*“^(7 r) — 1. Then 


ai — 2(ai_i) -|- 1 

= 2{2^-^{7n) - 1) -k 1 
= 2*-^(7n)-2-kl 
= 2*-^(7n) - 1. 


Thus, when rk is a power of 2, the primitivity of the extender set sequence of Gk 
begins before aiog^(^rk}+i = 2 ^°S 2 (’')=)( 7 „) _ i = - l. 

Now, the upper bound for the beginning of the periodicity of the extender set 
sequence certainly increases as increases-increasing rk means adding more graphs 
to construct ^^-and so, since rk < 2r'°S2(’'fe)l for all S N, and is 

a power of 2, for any rk, the primitivity of Gk must begin at the latest when 
£ = 7 ( 2 ri°g 2 (’-<e)l )n - 1 < 7 { 2 ^°S 2 (^A+i)n - 1 = 14(rfc)n - 1. 

Finally, it remains to show that in this construction, m < 39n^r^. We first show 
that G 2 (that is, r 2 combined copies of Gn,A 2 U...uAk) Fas at most 6 nr 2 vertices and 
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will have m < The bound on the number of vertices is clear-for any graph 

Qn,s constructed by the method defined at the beginning of this section, Qn,s has 
3n + 2|5'| + 1 vertices, and since [S’] < n and n > 1, we have 3n + 2|S'| + 1 < 6 n. 
With each graph having at most 6 n vertices, it is trivial that Q 2 has at most 6 nr 2 
vertices. As discussed in Theorem |4.2[ the number of extender sets for i > 3n+3 and 
^ (mod n) ^ S (that is, m for Gn,s) is (3n+2|5'| + l)^ + |5'| + 2 < 36n^+n+2 < 39n^. 
This proves the base case, when r 2 = 1. Suppose for an induction that after joining 
together i copies of Gn,A 2 U...uAk to make a graph G, we get m < and we then 

adjoin a single copy of Gn,A 2 U...uAk to G- Then, by Theorem 4.3 words of sufficient 
length £ in the new graph where £ (mod n) € Ai will have a number of extender sets 
equal to the number of extender sets for words of such length in G (bounded above 
by 39i^n^) plus the number of extender sets for words of such length in Gn,A 2 U...uAk 
(bounded above by 39n^) plus twice the product of the number of vertices in G and 
Gn,A 2 U...uAi, (bounded above by 2(6m)(6n) < 2f(39n^)). 

Thus, for the resulting graph containing i + 1 copies of Gn,A 2 U...uA^, we have: 

m < + 2i(39n^) = 39n^{f + l + 2i)= 39n^{i + l)^ 


giving the result for G2 when i = r2- 

We next consider adding {r^ — r2) many copies of Gn,A3U...uAk to G2 to make Gs- 
By the same argument as above, the graph consisting of (r^ — r2) many copies of 
Gn,A3U...uAk will have at most 6n(r3 — r2) vertices and m < 39 ‘n?(r^ — r2)^. Again 
using Theorem | 4 . 3 | to combine the two graphs, the resulting graph ^3 will have at 
most 6nr2 + 6n(r3 — r2) = 6 nr^ vertices, and will have 

m < 39n^r2 + 39n^(r3 — r2)^ + 2(6nr2)(6n(r3 — r2)) 

< 39n^r| + 39n^{r^ - r2)^ + 39n^(2(r2)(r3 - r2)) 

= 39ri^{rl + {r-^ - r2f + 2{{r2){r^ - r2)) 

= 39n^(r2 + (rs - r2)f' 

= 39v?r^. 

Continuing inductively, we can see that for Gk, we will have m < 39 n?r^. □ 


While we may achieve any desired oscillation scheme, we cannot achieve any 
eventually periodic sequence we like-m must be sufficiently large. 

Theorem 4.4. Let X be an irreducible sofic shift with liminf{|TA(^)|} = w and 
limsup{|T’x(^)|} = m + r with least eventual period n. Then we have that m > 
log 2 (r) andm> ^ log 2 (log 2 (n)). //liminf{|Ax(f')|} = to' and limsup{| Ax(^)|} = 

m'+r' with least eventual period n', thenm' > •\/log 2 (r') andm' > ^^ log 2 (log 2 (n')). 

Proof. Let G be an irreducible right-resolving presentation of X which contains a 
right-synchronizing word. Let |C(^)| be denoted by V. Since a follower set of a 
word m in a sohc shift is determined by the non-empty set of terminal vertices 
of paths labeled w; in a presentation G^ X has less than \'P{y{G))\ = 2^ follower 
sets, and so to -|- r < 2^^. Because G is irreducible, right-resolving, and contains a 
right-synchronizing word, for large enough each singleton will correspond to the 
follower set of some word for any length greater than £. Because to occurs inhnitely 
often in the follower set sequence, to must be greater than or equal to the number 
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of singletons in Q, that is, m > V. Thus, we have: 

2"^ > 2^ >m + r>r 


m > log 2 (r). 

Moreover, as there are less than 2^ follower sets, the least eventual p erio d n of 
the follower set sequence is less than or equal to (2'^)!, as in Theorem Thus 
(2^)! > n. So we have: 

( 2 m)( 2 ™) ^ (2™)! > (2^)! > n 
(2™)(2™) > n 
log2((2'")(2’")) > log2(n) 

2™log2(2-)>log2(n) 

2""(m) > log 2 (n) 

logs (2™) + log2(™) > logs (logs (n)) 
m + \og 2 {m) > log 2 (log 2 (n)). 

Since m > log 2 (m), we have: 

2 m > logs (logs (n)) 

"I > ^ logs (logs (ii))- 

Now, an extender set of a word w in a sofic shift is determined by the non-empty 
set of pairs of initial and terminal vertices of paths labeled w in so X has less 
than 2^ extender sets, that is, to' -I- r' < 2^^ . Since two words with the same 
extender set have the same follower set, m' > m > V. Thus we have: 

2 ™'" > 2 ^' > to' + r' > r' 


to'^ > log2(r'') 
m > \/logs(r'). 


Finally, as there are less than 2'^ extender sets, by Theorem 1.1 (2" )! > n', 
giving: 

(2'"'")(2”'') > (2™')! > (2^')! > n' 

(2™'')(2'"'') > n' 

(2”'")(TO'")>log2(n') 

-hlog2(TO'^) > logs (logs (n')). 


Since to'^ > log 2 (TO'^), we have: 


2m' > logs (logs (n')) 


to ' > 



logs (logs (n'))- 


□ 


Remark 4.5. For the examples discussed in this paper, we may take r or r' = r^. 
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5. The Non-Sofic Case 

In this section we demonstrate the existence of a non-sofic shift whose follower set 
sequence and extender set sequence are not monotone increasing. The construction 
uses the following fact about Sturmian shifts (for a definition, see [T]): 

Lemma 5.1. IfY is a Sturmian shift, then for any i G N, |Ty-(£)| = |i?y(£)| = £+ 1 . 

Proof. From [T], it is known that for a fixed length £, Sturmian shifts have exactly 
£ + 1 words in Li{Y), so it is sufficient to show that any two words of length £ in 
Y have distinct follower and extender sets. We also know from [1] that Sturmian 
shifts are symbolic codings of irrational circle rotations, say by a ^ Q, where the 
circle is expressed by the interval [0,1] with the points 0 and 1 identified, and the 
interval coded with 1 has length a. We may take a < ^ by simply switching 
the labels 0 and 1 whenever a > |. Furthermore, the cylinder sets of words of 
length £ correspond to a partition of the circle into £ + 1 subintervals, so for two 
words of length £ in Y, each corresponds to a subinterval of the circle, and the two 
subintervals are disjoint. Let w and v be two distinct words in Li(Y) corresponding 
to disjoint intervals 1 ^ and [0,a) be the interval coded with 1, and Ta be the 
rotation by a. We claim that there exists an iV S N such that a) intersects 

one of In, and ly but not the other: Since a < |, and since {na | n £ N} is dense 
in the circle, if one of ly, and ly has length at least there exists iV £ N such 
that T~^[0, a) is contained entirely inside that large interval, and thus completely 
disjoint from the other. Otherwise, take /((,, which clearly has length at least and 
find an TV £ N such that a) is contained inside 7° and intersects ly C If,, 

again possible due to denseness of {na \ n £ N}. Hence we have proved our claim, 
that 3 N G N such that T~^[0,a) intersects one of ly, and /„ but not the other, 
and therefore, that the symbol 1 may follow one of the words w and v exactly N 
units later, but not the other. Therefore w and v have distinct follower sets, and 
thus, distinct extender sets, completing the proof. □ 

We use Lemma 15.11 and the sofic shifts constructed in Section |4] to build a non- 
sofic shift with non-monotonically increasing follower and extender set sequences: 

Proof of Theorem \1.4\ Take a sofic shift X = g for any n, S as defined in 
Section Take the direct product of X and a Sturmian shift Y. Two words in 
X X Y have the same extender set if and only if the projection of those words to 
both their first and second coordinates have the same extender set in X and Y, 
respectively. That is, if two words w and v have different extender sets in X, then 
any two words whose projections to their first coordinate are w and v will have 
different extender sets in X x Y, and similarly for words w' and v' with different 
extender sets in Y. Therefore \Exxy{^)\ = |7'x(£)| • \Ey{^)\- By similar logic, 

\FxxYie)\ = \Exm-\EYm. 

Thus, if we let m = liminf{|i?x(£)|}^GNi then for any £ > 3n-|-3 with £ (mod n) ^ 
S, we have |7?axu(£)| = m ■ {£ + 1), and if £ (mod n) G S, then |71axy(£)| = 
(m-I- 1)(£-|- 1). As TO is fixed and £ approaches infinity, it is clear that {\Exx Y{m 
is unbounded, and thus the shift A x T is nonsofic. Furthermore, as the direct 
product of a mixing shift (X is primitive by Lemma |4.1[ and therefore mixing) 
with an irreducible shift, A x T is irreducible. 

Choose £ large enough that £ > to — 1, and such that £ (mod n) G S and £ -I- 1 
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(mod n) ^ S. Then 

\Exy.Y{.()\ = (iR + + 1) 

= mi + m + ^ + 1 
> m£ + m + (m — 1) + 1 
= + 2m 

= m(£ + 2) 

= \Exy.Y{£ + 1 ) 1 - 

Therefore the extender set sequence of X x T is not monotone increasing. A similar 
argument shows that the follower set sequence of A x T is not monotone increasing 
as well. □ 

Example 5.2. Let X = Xg^ Then m = liminf{|ifx(^)|}^6N = (3n + 2|S'| + 
1)^ + [S'! + 2 = 84, so for £ = 84 (since 84 > 3n + 3,84 > m — 1, 84 (mod 2) G {0}, 
and 85 (mod 2) ^ {0}), \Exy.Y{£^)\ > \Exy.Y{£+ 1)1- In particular, |ifxxT(84)| = 
(85) (85) = 7225 while |Exxy(85)| = (84) (86) = 7224. 

Remark 5.3. The reader may observe that once £ is sufficiently large for the 
follower or extender set sequence of A x F to decrease, these decreases will happen 
for exactly the same lengths £ as the decreases in the follower or extender set 
sequence of A = Xg^ ^. Thus there are infinitely many lengths for which the 
follower or extender set sequence of A x F decreases. 
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